Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?

نویسندگان

  • L McAuley
  • B Pham
  • P Tugwell
  • D Moher
چکیده

BACKGROUND The inclusion of only a subset of all available evidence in a meta-analysis may introduce biases and threaten its validity; this is particularly likely if the subset of included studies differ from those not included, which may be the case for published and grey literature (unpublished studies, with limited distribution). We set out to examine whether exclusion of grey literature, compared with its inclusion in meta-analysis, provides different estimates of the effectiveness of interventions assessed in randomised trials. METHODS From a random sample of 135 meta-analyses, we identified and retrieved 33 publications that included both grey and published primary studies. The 33 publications contributed 41 separate meta-analyses from several disease areas. General characteristics of the meta-analyses and associated studies and outcome data at the trial level were collected. We explored the effects of the inclusion of grey literature on the quantitative results using logistic-regression analyses. FINDINGS 33% of the meta-analyses were found to include some form of grey literature. The grey literature, when included, accounts for between 4.5% and 75% of the studies in a meta-analysis. On average, published work, compared with grey literature, yielded significantly larger estimates of the intervention effect by 15% (ratio of odds ratios=1.15 [95% CI 1.04-1.28]). Excluding abstracts from the analysis further compounded the exaggeration (1.33 [1.10-1.60]). INTERPRETATION The exclusion of grey literature from meta-analyses can lead to exaggerated estimates of intervention effectiveness. In general, meta-analysts should attempt to identify, retrieve, and include all reports, grey and published, that meet predefined inclusion criteria.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Systematic review finds that study data not published in full text articles have unclear impact on meta-analyses results in medical research

BACKGROUND A meta-analysis as part of a systematic review aims to provide a thorough, comprehensive and unbiased statistical summary of data from the literature. However, relevant study results could be missing from a meta-analysis because of selective publication and inadequate dissemination. If missing outcome data differ systematically from published ones, a meta-analysis will be biased with...

متن کامل

Meta-analysis of psychological intervention for chronic pain: Challenges and Strategies for research quality improvement

 Aims and background: Chronic pain is a pervasive, destructive and expensive problem with a biopsychosocial nature. Psychological interventions suggested to be an effective choice for chronic pain, and many trials  confirmed its effectiveness and several meta-analyses have estimated the amount of its effect. Considering the psychological and social aspects of pain, it’s possible that the Irania...

متن کامل

Prevalence of cigarette smoking among Iranian women: a systematic review and meta-analysis

  Background: Smoking has physical, psychological, and social impacts on women’s health and subsequently the community’s health. Therefore, it is important to have an estimation of smoking among Iranian women.   Since comprehensive data are not available in this respect, the authors performed a systematic review and metaanalyzed all high-quality studies in this field.   Methods: All available e...

متن کامل

On the effectiveness of integrated skills approach in language teaching: a meta-analysis

This meta-analysis was conducted to synthesize the effect of 22 primary studies which have been conducted to test the effect of the integrated skills approach (ISA) on language skills and components. Three questions guide this analyses: What is the overall effect of ISA  on language skills and sub-skills? To what extent moderator variables such as learners level of education and proficiency mod...

متن کامل

Prevalence of integron classes in Gram-negative clinical isolated bacteria in Iran: a systematic review and meta-analysis

Objective(s): Integrons, as a potential element in the distribution and maintenance of drug resistance, have thoroughly been established. It is known that the high prevalence of integrons in multidrug-resistant (MDR) clinical isolates has become a serious public health concern. The objective of the present study was to determine the frequency of different classes of integrons in clinical isolat...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Lancet

دوره 356 9237  شماره 

صفحات  -

تاریخ انتشار 2000